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Bayesian  Analysis  of  Item  Response  Curves 
Abstract 

Item  response  curves  for  a  set  of  binary  responses  are  studied 
from  a  Bayesian  viewpoint  of  estimating  the  item  parameters.  For 
the  two-parameter  logistic  model  with  normally  distributed  ability, 
restricted  bivariate  beta  priors  are  used  to  illustrate  the  compu¬ 
tation  of  the  posterior  mode  via  the  EM  algorithm.  The  procedure 
is  illustrated  by  data  from  a  mathematics  test. 


Key  Words:  Item  responses,  Bayesian  estimation,  EM  algorithm. 
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Introduction 

We  will  consider  dichotomous  responses  to  a  set  of  test  items 
which  are  designed  to  measure  the  abilities  of  individuals.  We 
assume  that  each  item  is  characterized  by  an  item  response  curve, 
a  function  of  ability  which  is  indexed  by  unknown  parcimeters  called 
item  parameters.  We  consider  a  Bayesian  method  for  estimating 
these  parameters  when  the  abilities  of  the  individuals  are  assumed 
to  have  a  normal  prior  distribution. 

A  standard  method  for  estimating  abilities  and  item  parameters 
in  the  absence  of  prior  information  is  maximum  likelihood  (see 
Lord  [1980]).  Under  the  assumption  that  abilities  are  normally 
distributed,  the  maximum  likelihood  (m.l.)  estimates  of  item  para¬ 
meters  have  been  studied  through  various  applications  of  the  EM 
algorithm  [Dempster,  Laird,  and  Rubin,  1977]  by  Sanathanan  and 
Blumenthal  [1978] ,  Bock  and  Aitkins  [1981] ,  and  Rigdon  and  Tsutakawa 
[1983]  ,  cunong  others. 

The  Bayesian  hierarchical  approach  developed  for  linear  models 
by  Lindley  and  Smith  [1972]  has  been  adapted  to  estimating  item 
parameters  by  Swaminathan  and  Gifford  [1982] .  The  procedure  is 
dependent  on  obtaining  modal  estimates  as  a  solution  to  a  simulta¬ 
neous  system  of  a  large  number  of  equations.  As  suggested  by  the 
illustration  in  Novick,  Jackson,  Thayer,  and  Cole  [1972]  ,  one  of 
the  drawbacks  of  the  hierarchical  approach  is  the  difficulty  of 
specifying  the  hyperparauneter  for  the  prior  distribution. 

In  this  paper  we  show  how  the  computational  simplicity  of 
the  EM  algorithm  for  m.l.  estimation  of  item  parameters  continues 
to  hold  in  finding  the  posterior  mode,  provided  the  item  parameters 
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have  independent  prior  distributions.  This  simplicity  consists  of 
being  edale  to  work  iteratively  one  item  at  a  time  rather  than  with 
all  items  simultaneously. 

We  also  introduce  a  new  family  of  priors  for  the  item  parameters, 
which  we  believe  can  be  more  readily  specified  in  practice.  It  is 
based  on  the  user's  prior  belief  cibout  the  probability  of  correct 
response  to  each  item  for  subjects  at  given  percentiles  of  the 
ability  distribution. 

An  important  difference  between  Swaminathan  and  Gifford's  result 
and  ours  is  that,  whereas  they  obtain  the  joint  posterior  mode  of 
ability  and  item  parameters,  we  obtain  the  marginal  posterior  mode 
of  the  item  parameters.  The  work  by’  O'hagan  [1976]  on  linear  models 
suggests  the  two  approaches  can  lead  to  different  results  and  the 
marginal  mode  is  preferred  when  the  ability  parameters  are  considered 
nuisance  parauneters. 

We  will  start  by  stating  the  general  model  and  assumptions. 

For  the  general  model  we  derive  expressions  for  the  marginal  pos¬ 
terior  distribution  of  item  parameters  and  show  how  the  EM  algorithm 
can  be  used  to  compute  the  posterior  mode.  For  the  two-parameter 
logistic  model  [see  Lord,  1980]  we  introduce  prior  distributions 
on  the  item  parameters  via  restricted  bivariate  beta  distributions. 

The  Bayesian  approach  is  illustrated  with  responses  to  a  mathematics 
test  used  by  the  Americeui  College  Testing  Program  (ACT) .  A  preliminary 
sample  of  40  exauninees  is  used  to  formulate  priors .  These  priors  are  then 
used  on  the  main  sample  of  400  examinees.  The  uncertainty  in  the 
estimates  is  given  by  the  posterior  covariance  matrix,  which  is 
approximated  through  the  curvative  of  the  posterior  distribution 
at  the  mode.  The  posterior  modes  are  then  compared  to  the  more 
conventional  m.l.  estimates  by  using  LOGIST  [Wingersky,  Barton, 
and  Lord,  1982]  amd,  as  might  be  expected  for  the  sample  size  used, 
the  two  point  estimates  are  shown  to  be  in  close  agreement. 
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General  Model  for  Item  Responses 

Consider  binary  responses  to  a  set  of  k  test  items  by  a  set 
of  n  examinees  for  evaluating  some  characteristics  of  the  items. 

Let  =  0  or  1,  according  as  the  response  of  examinee  i  to  item 
j  is  incorrect  or  correct,  i  =  1,...,  n;  j  =  l,...,k.  Assume  a 
probability  model 

Pij  =  P(V.J  =  l|6i,  1^)  (1) 

depending  on  a  real  valued  ability  parameter  9^  and  a  real  or  vector 
valued  item  parameter  Cj.  Although  our  numerical  illustration  will 
be  for  the  2-parameter  logistic  model,  the  discussion  in  this  sec¬ 
tion  applies  more  generally  to  the  one  and  three-parameter  logistic 
models  and  corresponding  probit  models. 

We  assume  conditional  independence  among  the  responses,  so  that 
T  T 

given  9  =  (9j^,...,9^)  and  5  =  p . . .  ,  the  joint  probability 

of  the  n  X  k  matrix  of  responses  Y  is 


n  k  y 


=  iSi  jSi  p'ij^  (1  -  Pij)^  ■ 


1  -  y.. 


(2) 


We  further  assume  that  9  and  5  have  independently  distributed  prior 
distributions  with  pdf's  p(9)  and  p(C) ,  respectively. 

The  posterior  distribution  of  (9,5)  is  then  given  by  the  pdf 

P(9,§ly)  =  (3) 

where  P(y)  is  the  marginal  probability  function  of  Y.  The  marginal 
posterior  pdf's  of  9  and  5  sre  then 
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and 


p(9|y)  = 


p(C|y)  = 


p(e} jp(y|0»§)p(|)d| 

p(fr 

P(C) fp<yle»§)p(0)de 
p(y)'  ■ 


(4) 


(5) 


A  relation  between  P(9|y)  and  p(Ciy)  may  be  seen  in  the  alternative 
expressions 

p(9iy)  = 

and  ~  ~ 


where 


and 


P(C|y,9)  « 


p(9|Y,€)p(C|y)d| 

16) 

p(§ly»6)p(9 |y)de , 

(7) 

P(yl9,|)p(9) 

p~(ylS) 

(8) 

P(y!9,|)p(|) 

P(y[8) 

(9) 

which  are  the  posterior  pdf’s  of  8  and  5,  given  5  and  8,  respectively, 
The  equivalence  of  (4)  to  (6)  and  (5)  to  (7)  may  be  seen  by  noting 
that 

p(9|y)/P(yl8)  =  p(e)/P(y) 

and 

p(C|y)/P(y!C)  =  p(C)/P(y) , 

whenever  P{y) ,  p(9) ,  and  p(|)  are  positive. 

If  independent  then  (4)  reduces  to 

P(9|y)  -  jai|iiiP<yijl0i'!j)P(|j)d§j 


(10) 


(11) 


(12) 


and  similarly  if  8j^,...,8j^  are  independent  then  (5)  reduces  to 

p(§!y)  «  P(§)iSi  jliP(yijl9i»|j)P(0i)d9^.  (13) 


We  note  that  the  integrals  in  (12)  have  dimensions  equal  to  the 
dimensions  of  the  item  parameters  |j ,  but  those  in  (13)  are  single. 
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Computing  the  Posterior  Mode  of  C 


When  independent,  the  EM  algorithm 

[Dempster,  Laird  and  Rubin,  1977]  is  a  powerful  tool  for  computing 
the  posterior  mode  C  of  C •  The  computation  of  the  posterior  mode 
of  9  is  somewhat  more  difficult  since  multiple  integrals  of  order 
equal  to  the  dimension  of  must  be  numerically  evaluated.  Here 


we  restrict  our  discussion  to 

In  the  terminology  of  the  EM  algorithm,  (Y,0)  is  the  complete 
data  and  C  the  unknown  pareuneter.  Y  is  the  incomplete  (or  observed) 
data  and  0  the  missing  data.  The  joint  distribution  of  {Y,0)given5  is 


=  ill  jaiP(yijl9i'|j)p(ei) 


(14) 


To  find  the  m.l.  estimate  of  C,  the  EM  algorithm  uses  a  function 
of  5  defined  by 


Q(||C“)  =  E{log  p(y,0lC) |y,|»} ,  (15) 

where  the  expectation  is  with  respect  to  9  conditionally  on  y  and 
some  fixed  value  of  C[see  Ridgon  and  Tsutakawa,  1983].  To  find 
the  posterior  mode  of  5 ,  we  append  to  Q  the  log  of  the  pdf  of  5 
and  work  with  the  function. 


R(C|C“)  =  0(515“)  +  log  p(5)  . 


(16) 


(See  end  of  section  2  in  Dempster,  Laird  and  Rubin  [1977].) 
In  the  case  of  independence,  described  above,  R  reduces  to 


R(5 


5l5“)  =  ill  jlijlog  P(yij|9i,5j)p(9iiy,5“)d9i 


*  ’'jSiJ 


log  p(9i)p(0i!y,5“)d0i  ' 


+  jlilog  P(5j) 


(17) 
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Basically,  the  EM  algorithm  starts  with  some  initial  value  C®  and 
iteratively  maximizes  R(CU“)  with  respect  to  C  while  holding  C® 
fixed  and  replacing  5®  by  the  maximizing  value  at  the  beginning 
of  the  successive  iterations.  The  iteration  continues  until  some 
convergence  criterion  is  satisfied.  We  note  that  the  middle  term 
on  the  right  hand  side  of  (17)  may  be  ignored  since  it  does  not 
depend  on  C.  Moreover,  since  the  summands,  with  respect  to  j ,  of 
the  remaining  terms  of  (17)  are  each  a  function  of  a  single  5 j , 
we  may  maximize  R(C|5®)  by  maximizing  separately  for  j  =  l,...,k, 

Jjiog  P(yijlei.?j)p{eily,r)  de. 

+  log  p(|j) .  (18) 

A 

Upon  convergence  the  final  value  5  of  5®  maximizes  the  posterior 
pdf  (4)  . 
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Class  of  Priors  for  Two-parameter  Logistic  Curves 


To  illustrate  some  of  the  computational  work  needed  to  imple¬ 
ment  the  EM  algorithm  we  consider  the  two-parameter  logistic  model 


defined  by 


or  equivalently 


i  j  1  +  exp{-  otj  -  2  j  ) 


exply^j  (6^  -  3^) ) 

"  1  +  expia^ (9^  -  3 j) 1  (19) 

for  y^^j  =  0,1;  i  =  l,...,n;  j  =  l,...,k  where  we  now  have 
T 

Cj  *  (OjfSj)  with  Oj  >  0  and  -«  <  3^  <  “>.  We  assume  that 

2 

01,..., 9n  are  iid  N(0,1).  Note  that  if  we  use  N(y,a  )  with  unknown 
2 

(y,a  )  in  place  of  N(0,1),  the  parameterization  in  (19)  would  not 
be  unique  without  some  restriction  on  (aj,3j). 

For  the  prior  distribution  of  (0^,0^)  we  consider  the  family 
of  bivariate  pdf's  of  the  form 


p(a,3lw)  « 


^1  ®1  ^2  ^2 
a  Pj^  (1  -  Pj^)  P2  "  P2^  ,  if  a  >  0 


a  s  0 , 


where 


^u  1  +  exp{-  oi(t^  -  3) 


,  u  =  1,2 , 


is  a  known  hyperparameter  with  tj^  <  t2  and  >  0,  u  =  1,2. 

When  (ct^ ,3^^)  f  f  (cij^ /0j^)  are  independent  with  possibly  different 

T 

hyperparameters  w  =  (w^/.^.rWj^)  ,  the  joint  pdf  is 
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p(C(w) 


w.) 


(22) 


The  use  of  this  family  of  priors  may  be  motivated  through  the 
examinee's  prior  belief  about  the  probability  of  correct  responses 
to  the  items  at  different  ability  levels.  The  family  of  natural 
conjugate  priors  for  the  binomial  distribution  with  parameter  p  is 
the  set  of  beta  distributions. 


p'^’^d  -  p)^  ^  if  0  <  p  <  1 
g(plr,s)  «  1  (23) 

(0  if  otherwise, 

where  the  hyperparameter  is  (r,s)  with  r,s  >  0.  For  two  independent 
binomials  having  parameters  and  P2  with  the  restriction  <  P2, 
the  family  of  natural  conjugate  priors  is  the  restricted  beta, 


g(Pl/P2  ^i'Si,r2,S2} 


r^-1 


(1  -  P.) 


®1-^  _^2 


1  -  s 


Pod  -  Po) 


2  .. 


if  0  <  p^  <  P2  <  1 


0  if  otherwise. 


(24) 


where  the  hyperparameter  is  (r^,s^,r2 ,82)  with  >  0,  u  =  1,2. 

The  constant  of  proportionality  K  is  given  by 


K 


-1 


\F2 


00 


ri-1  s  -1  r  -1 

(1  -  Pi)  P2"  (1  - 


®2-l 


p  2 )  dp  1  *^P  2  ‘ 


(25) 


which  is  finite  since  r  ,s  >0. 

u  u 

Conjugate  priors  have  been  advocated  for  many  distributions 
because  of  their  richness,  tractability  and  interpretability  [see 
Raiffa  and  Schlaifer,  1961].  The  fact  that  the  pdf's  have  the  same 
functional  form  as  the  lilcelihood  functions  ma)ces  it  convenient  to 
interpret  the  prior  as  the  liJtelihood  function  from  a  previous  ex- 
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periment  or  for  some  subjective  and  hypothetical  one.  A  member 

of  the  restricted  bivariate  beta  may  be  selected  by  specifying 

the  mode  (p-,  ,p,)  ,  p,  ,  ^  Po  the  amount  of  weight,  n  =  r  +  s  , 

u  =  1,2  to  be  placed  on  the  prior.  Given  these  specifications, 

the  value  for  (r  ,s  )  may  be  determined  from 
u  u 

r  =  1  +  (n  -  2)p 
u  u  ^u 

and  (26) 

s  =  n  -  r  . 
u  u  u 

For  a  given  item,  suppose  the  prior  distribution  of  probability 
of  correct  responses,  p^  and  P2,  at  ability  levels  t^^  and  t2 , 
ti  <  t2 ,  is  the  restricted  bivariate  beta  (24).  Under  the  two 
parameter  logistic  model,  this  then  implies  a  prior  on  (a,S)  through 
the  relation 

_ 1 _ 

^u  ~  1  +  exp {-a(t^-6)},  (27) 

u  =  1,2.  Using  standard  methods  for  deriving  distribution  of 
functions  of  random  variables,  it  is  readily  shown  that  the  pdf  of 
(ci,S)  is  then  given  by  (20). 

We  have  thus  shown  how  the  prior  of  (a,S)  for  a  given  item 
may  be  obtained  through  the  prior  for  (Pj^,P2)  •  Many  investigators 
may  find  it  easier  to  select  a  prior  for  (pj^,P2)  at  levels  (tj^,t2) 
than  one  for  (a,  6)  directly.  Although  the  choice  of  (t2^,t2)  is  ar¬ 
bitrary  and  may  vary  from  item  to  item,  or  user  to  user,  familiar 
levels  such  as  the  25  and  75  percent  points  of  the  ability  levels 
are  likely  to  be  easier  to  work  with.  In  working  with  the  N(0,1) 
distribution  these  are  ±  0.674.  The  use  of  these  ideas  will  be 
illustrated  in  the  examples  to  follow. 
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Computational  Notes 


The  computation  required  for  deriving  the  posterior  mode 
under  the  two-parameter  logistic  model  is  an  extension  of  that 
developed  for  m.l.  estimation  by  Tsutakawa  [1983].  We  now  sum¬ 
marize  some  of  the  compututational  formulas  when  the  restricted 
bivariate  prior  is  used. 

According  to  (18) ,  at  each  iteration  of  the  EM  algorithm 

T 

we  are  given  and  must  maximize,  with 

respect  to  the  functions 


F  .  =  T  .  +  S  . 
3  3  3 


3  = 


1 , . . .  ,k ,  where 

n  f  (expCy^.  a  (9  -  S .)] 

T.  =  .E,  logi - iJ— 3 i - 

J  1  +  exp[a.(9.  -  Bj)]] 


p(0ilyi»f ‘’)d6i/ 


S.  =  log  a.  +  E, (r  .  log  p  .  +  s  •  log  q  .) , 
3  u=l  U]  ^  ^U]  U3  ^  U] 


and 


p{9ilyi»f°)  «  exp 


2  k  exp{y  a?(e  -  S?)} 

(-  ef/2).n, - riJ 3 — i - 3 —  , 

^  1  +  exp{a?(0.  -  S?) 


(29) 


(30) 


the  posterior  pdf  of  9^  given  C®*  The  maximization  must  be  performed 
numerically  by  some  iterative  method  such  as  that  of  Marquardt  [1963] 
The  computational  expressions  for  the  first  two  derivatives  of  Fj 
with  respect  to  (ocyS^)  ,  which  are  needed  for  Marquardt's  method, 
have  been  used  for  m.l.  estimation  and  summarized  in  Tsutakawa  [1983] 
The  first  two  derivatives  of  Sj  are  considerably  simpler  to  evaluate 


and  given  by 


+ 


n  .  p  . ) 


(31) 


9S,  2 

=  -  uSl^^uj  -  "uj  Puj)' 


33j 


(32) 


.2  2  2 

— ^  =  -  a  ^  -  E,(t.-e.)^w., 

3^2  u=l  UD  3  U3' 

j 


(33) 


3^  3. 


)aj  agj  "  "  ■  "^uj  “j  u=l 


Sj)  w^.,  (34) 


3^3 


agj 


2  2 

■SC-*  —  —  ot .  Z  1  w  •  # 
2  3  u~l  u] ' 


(35) 


where 


and 


w  .  =  n  .  p  .  q  . 
U3  U3  ^U3  ^u] 


Puj  =  1  ^  ^  exp(-  -  s.)). 


(36) 


With  some  additional  computation,  the  posterior  covariance 
matrix  of  C  may  be  approximated  by  the  inverse  of  the  second  deri¬ 
vative  matrix  of  the  negative  log  posterior  of  5  evaluated  at  the 
posterior  mode  [see  Leonard,  1975] .  From  (13)  and  (19)  we  see  that 
the  log  of  the  posterior  pdf  of  C  is  the  sum  of  two  terms 


D  f  k  r 

log  p(|)  +  iij^log  jnj^p(y^j  I  0^,0^  ,gj)p(9^)d0^ 


(37) 


where  the  first  term  is  j4]^Sj  second  is  the  log  marginal 

likelihood  function.  The  second  derivatives  of  the  first  term 
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Example 

The  Bayesian  method  will  now  be  illustrated  using  responses 
from  a  random  sample  of  400  examinees  to  39  items  used  in  the 
mathematics  portion  of  a  1983  ACT  exaunination.  Although  the  ori¬ 
ginal  set  consisted  of  40  items,  one  item  was  deleted,  because  its 
low  item  score  and  apparent  high  frequency  of  guessing  suggested 
its  departure  from  the  two-parameter  logistic  model. 

In  order  to  formulate  prior  distributions ,  a  preliminary  ran¬ 
dom  Scunple  of  40  examinees  was  taken  and  a  probit  analysis  [Finney, 
1971]  was  performed  on  each  item  against  the  raw  scores,  i.e. , 
j=l  ^i j  '  practice  one  may  use  data  from  a  preliminary  test 

of  the  items.)  For  each  item  the  estimated  probability  of  correct 

^  A 

responses  p^^  and  P2  at  the  25th  and  75th  percentiles  of  the  raw 
scores  were  computed.  These  estimates  were  then  used  as  the  prior 
modes  at  the  25th  and  75th  percentiles  of  the  N(0,1)  distribution 
of  abilities,  i.e.,  t2j  =  -  t^^  =  0.674.  (Although  the  logit 
analysis  would  seem  more  appropriate  than  the  probit,  due  to  the 
similarities  of  the  normal  and  logistic  curves,  the  difference  in 
the  estimated  probabilities  should  be  negligible.)  For  all  items, 
n^j  =  7  was  used  as  the  prior  weight  and  computed  accord¬ 

ing  to  (26).  (See  listing  in  Table  1.)  Although  the  choice  of  7 
is  partly  subjective,  it  seemed  more  realistic  and  conservative 
than  the  somewhat  larger  values  suggested  by  the  asymptotic  variances 
obtained  from  the  probit  analysis. 

Insert  Table  1  about  here 
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Table  1  lists  the  posterior  modes  and  approximate  variances 
and  covariances  of  Under  the  normal  approximation  these 

values  may  be  used  to  compute  interval  estimates  and  to  assess 
the  uncertainties  in  the  parameter  values.  For  comparison  the 
joint  m.l.  estimate  of  item  and  ability  parameters  were  computed 
by  LOGIST.  Due  to  the  different  parameterizations  used,  the 
LOGIST  estimates  were  rescaled  to  correspond  to  the  Bayesian  ones. 
The  scatter  diagrams  in  Figures  1  and  2  show  that  both  methods 
produce  very  similar  point  estimates  of  the  item  parameters,  as 
might  be  expected  for  such  a  large  sample  size.  The  m.l.  estimate 
obtained  via  the  EM  algorithm  [see  Tsutakawa,  1983]  were  also  com¬ 
puted  for  the  same  400  examinees  and  found  to  be  indistinguishable 
from  the  posterior  modes. 

Insert  Figures  1  &  2  about  here 

One  advantage  of  the  Bayesian  over  the  m.l.  approach  is  that 
it  provides  results  which  have  probabilistic  interpretations  based 
on  the  observed  data.  This  advantage  however  is  at  the  expense 
of  having  to  specify  a  prior  distribution  for  the  item  parameters. 
For  data  sets  as  large  as  the  one  considered  here,  the  resulting 
posterior  distributions  are  not  likely  to  be  very  sensitive  to 
changes  in  priors,  provided  they  are  not  excessively  "informative". 
This  was  verified  by  performing  additional  runs  with  n^j  =  3.5 
and  14.0,  corresponding  to  one  half  and  double  the  weights  used  in 
our  exeunple. 
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TABLE  1 

Bayesian  Parameter  Estimate  for  ACT  Math  Test 


A 


Item 

xlio 

P2 

Item 

Mode 

V(a) 

Cov(a,B) 

V(8) 

No. 

Score 

a 

8 

xlOO 

XlOO 

XlOO 

1 

67 

80 

281 

1.42 

-0.88 

2.89 

0.73 

0.96 

2 

53 

81 

251 

0.90 

-0.73 

1.86 

0.96 

2.08 

3 

53 

100 

258 

1.48 

-0.64 

2.96 

0.35 

0.70 

4 

47 

84 

241 

1.01 

-0.55 

2.02 

0.55 

1.36 

5 

32 

67 

194 

0.68 

0.05 

1.44 

-0.24 

2.30 

6 

33 

76 

236 

1.42 

-0.41 

3.00 

0.15 

0.65 

7 

59 

97 

298 

1.32 

-1.11 

2.97 

1.36 

1.61 

8 

28 

83 

241 

0.99 

-0.55 

1.98 

0.55 

1.39 

9 

32 

72 

225 

1.07 

-0.34 

2.13 

0.22 

1.06 

10 

34 

70 

218 

1.21 

-0.25 

2.44 

0.05 

0.83 

11 

21 

82 

193 

1.13 

0.01 

2.29 

-0.23 

0.94 

12 

33 

86 

215 

1.42 

-0.22 

3.08 

-0.06 

0..63 

13 

10 

89 

168 

1.50 

0.23 

3.44 

-0.48 

0.65 

14 

30 

64 

179 

1.01 

0.19 

1.99 

-0.41 

1.20 

15 

26 

82 

215 

1.54 

-0.21 

3.48 

-0.11  ■ 

0.54 

16 

8 

69 

170 

1.05 

0.30 

2.07 

-0.52 

1.18 

17 

27 

87 

182 

1.19 

0.12 

2.45 

-0.35 

0.89 

18 

6 

63 

161 

1.45 

0.31 

3.28 

-0.56 

0.72 

19 

31 

85 

196 

0.95 

-0.02 

1.91 

-0.16 

1.25 

20 

37 

89 

191 

0.81 

0.05 

1.64 

-0.24 

1.66 

21 

26 

87 

232 

1.25 

-0.40 

2.55 

0.22 

0.83 

22 

14 

49 

133 

1.48 

0.59 

3.23 

-0.76 

0.81 

23 

48 

87 

199 

0.88 

-0.06 

1.75 

-0.09 

1.42 

24 

19 

91 

172 

1.37 

0.20 

2.95 

-0.44 

0.73 

25 

15 

63 

206 

0.96 

-0.11 

1.92 

-0.04 

1.21 

26 

19 

60 

174 

1.31 

0.20 

2.77 

-0.45 

0.79 

27 

29 

71 

146 

1,05 

0.57 

1.99 

-0.79 

1.40 

28 

9 

93 

162 

2.03 

0.22 

6.96 

-0.69 

0.44 

29 

33 

91 

190 

1.63 

0.00 

4.01 

-0.35 

0.53 

30 

15 

46 

125 

0.90 

0.97 

1.68 

-1.34 

2.64 

31 

5 

70 

168 

1.48 

0.24 

3.43 

-0.51 

0.67 

32 

10 

47 

107 

0.87 

1.28 

1.66 

-1.87 

4.02 

33 

28 

77 

213 

1.01 

-0.21 

2.00 

0.06 

1.13 

34 

5 

30 

116 

0.75 

1.30 

1.55 

-2.25 

5.70 

35 

14 

61 

121 

0.75 

1,18 

1.47 

-1.86 

4.63 

36 

48 

64 

181 

0.71 

0.23 

1.46 

-0.51 

2.27 

37 

12 

44 

93 

1.37 

1.10 

2.73 

-1.19 

1.43 

38 

11 

47 

113 

0.93 

1.12 

1.73 

-1.54 

2.96 

39 

4 

56 

80 

1.20 

1.39 

2.34 

-1.65 

2.44 

BAYESIAN  ALPHA 


BAYESIAN  BETA 
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Figure  2.  Bayesian  vs.  Legist  Estimates  of 
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Dept,  of  Psychology 
Univ.  of  So.  California 
Uoi varsity  Park 
Los  AogtlH,  CA  90007 

1  Dr.  Hans  Croafeag 
Education  Rtstarch  Cmtir 
Univorsity  of  Liydan 
Dotrhaavolaan  2 
2S»  EN  Leydan 
Thi  NETietLANDS 

1  Lot  Cronbach 
16  Laburnuo  Road 
Athorton,  CA  9<-203 

1  CTB/NcSrau-Hill  Library 
2300  Sardon  Road 
Nontoray,  CA  93940 

I  Dr.  Haltar  Cunninghao 
Univorsity  of  Riui 
Dapartaont  of  Psychology 
Sainasvilla,  PL  32ill 

1  Dr.  Dattpradad  Divgi 
Syracusa  University 
Dapartaant  of  Psychology 
Syracuse,  RE  33210 

1  Or.  Eaaanual  Donchin 
Dapartaant  of  Psychology 
Univorsity  of  Illinois 
Chaapaign,  IL  01820 

1  Dr.  Hai-Ki  Dong 
Dali  Foundation 
Rooa  314,  Building  B 
800  Roosevelt  Road 
Sian  Ellyn,  IL  60137 

1  Dr.  Fritz  Brasgou 
Dapartaant  of  Psychology 
University  of  Illinois 
603  £.  Daniel  St. 
Chaapaign,  IL  61820 

1  Dr.  Susan  Eabertson 
PSYCHOLOeV  OEPARTHENT 
URIVERSm  OF  KANSAS 
Lauranca,  KS  6604S 


I  ERIC  Facility-Acquisitions 
4833  Rugby  Avanua 
Bathssda,  RD  20014 

1  Or.  Senjaain  A.  Fairbank,  Jr. 
NcFaaa-firay  6  AssociatH,  Inc. 

3825  Callaghan 
Suita  225 

Saa  Antonio,  T1  7B22B 

1  Or.  Ltesard  Feldt 
Lindquist  Caatar  for  Heasuraant 
University  of  Iona 
loaa  City,  lA  32242 

1  Univ.  Prof.  Dr.  Sarhard  Fischar 
Liebiggassa  3/3 
A  1010  Vienna 
AUSTRIA 

1  Professor  Dmald  Fitzgerald 
University  of  Nea  England 
Arsidale,  Raw  South  Rales  2331 
AUSTRALIA 

1  Dr.  Dexter  Fletcher 
Ibiiversity  of  Oregon 
Dapartaant  of  Coaputar  Science 
Eugene,  OR  97403 

1  Or.  John  R.  FredKiksan 
Bolt  Beraaek  6  Neaaae 
SO  lleulton  Street 
Caabridge,  RA  02138 

1  Or.  Janice  8ifford 
University  of  Nassachusetts 
School  of  Edacation 
Aeberst,  IM  01002 

1  Dr.  Robert  SlasK 

Learaing  Rnearch  6  Davolopaant  Center 
University  of  Pittsburgh 
3939  D'Hira  StrHt 
PinSORSN,  PA  13260 

1  Or.  Narrin  0.  SiKk 
217  Stone  Hall 
Comall  Ihiivsrsity 
ItbKa,  NY  14833 


IHsMuri-Coluabia/TsutakaM  i*J<m*84 

Private  SwtDr 

1  Sr.  Bart  Sraan 
Johns  Hopkins  Univarsity 
Oapartaant  of  Psychgloqy 
Char  las  k  34tb  Strnt 
Saltiaora,  HP  21218 

1  DR.  JAHES  6.  GREENO 

UtX 

tIRIVERSm  OF  PITTSMIROH 
3939  O’HARA  STRECT 
PmSBURBH,  PA  15213 

1  Or.  Ron  Haoblaton 
School  of  Education 
Uni  varsity  of  Hassachusetts 
Aaharst,  HA  01002 

1  Or.  Paul  Horst 
077  6  Straat,  1184 
Chula  Vista,  CA  90010 

1  Or.  Uoyd  Huophrays 
Oapartaant  of  Psychology 
University  of  Illinois 
603  East  Daniel  StrMt 
Chaipaign,  IL  61820 

1  Or,  Steven  Hunka 
Oapartaant  of  Education 
University  of  Alberta 
Edaonton,  Alberta 
CARAOA 

1  Dr,  Earl  Hunt 
Dept,  of  Psychology 
UnivKSity  of  Nashington 
Seattle,  M  98105 

I  Dr.  Jack  HuntK 
2122  Coolidge  St. 

Lansing,  HI  48906 

1  Dr.  Huynh  Huynh 
College  of  Education 
University  of  South  Carolina 
Coluobia,  SC  29208 

1  Dr.  Douglas  H.  Jooh 
Advanced  Statistical  TKhnologies 
Corporation 
10  Trafalgar  Court 
Laursnceville,  M  08148 


Page  7 

Private  Sector 

1  Or.  Harcel  Just 
Oapartaant  of  Psychology 
Carnegie-Heilon  University 
Pittsburgh,  PA  15213 

i  Or.  Oaaetriofl  Karis 
Oapartaant  of  Psychology 
University  of  Illinois 
603  E.  Danial  Street 
Cbaapaign,  IL  61120 

1  Profnsor  John  A.  Keats 
Oapartaant  of  Psychology 
Tha  University  of  Naucatle 
H.S.H.  2308 
AUSTRALIA 

1  Dr.  Hilliaa  Koch 
University  of  Teitu*Austin 
Haasuraaaot  and  Evaluation  Center 
Austin^  n  78703 

1  Dr.  Alan  Lasgold 
Learning  RbO  Center 
Univarsity  of  Pittsburgh 
3939  O’Hara  Straat 
Pittsburgh,  PA  15260. 

1  Dr.  Hichaal  Levina 
Oapartaant  of  Educational  Psychology 
210  Education  Bldg. 

University  of  Illinois 
Cbaapaign,  IL  61801 

1  Ih-.  Charles  Louis 
Facultait  Sociaie  Hatmschappen 
Rijksunivsrsitoit  Sroningen 
(bids  OoteringMtraat  23 
97126C  Broningen 
Hatharlands 

1  Or.  Robert  Linn 
College  of  Edwation 
University  of  Illinois 
Urbana,  IL  61801 

1  Hr.  Phillip  Livingston 
Systsas  and  Allied  Sciences  Corporatio 
6611  Kaniluorth  Avenue 
Rivsrdale,  HO  20840 


r 


!lis«wrt-Coiiii6ia/Tsut«liaM 

Privjti  SKtor 

1  Or.  RafeKt  LockHn 
Cintir  far  Naval  Analysis 
200  north  Staurtfartf  St. 
AlnanNria,  VA  22311 

1  Or.  rradaric  ».  Lxd 
EdncatlMal  Ttitiny  Sarvict 
Princiton,  W  08341 

1  Dr.  Jaws  limOfn 
Oapartaant  of  Psychol ooy 
Uairxsi ty  of  Nastxn  Aostralla 
NcdlanOs  V.h.  SOW 
AUSTRALIA 

1  Dr.  Don  Lyon 
P.  0.  Bat  44 
Woiey  ,  A2  83234 

I  Or.  Sary  Rarco 
Stop  31-E 

Educational  Testing  Sxvice 
Princeton,  NJ  08431 

1  Or,  Scott  nuNfil 
Oepartoant  af  Psychology 
Uoivxsity  of  Notre  Oaae 
Notrn  Oaae,  IN  44334 

1  Or.  Saauai  T.  Hayo 
Loyola  Univxsity  of  Chicago 
820  north  Nichigan  Avanua 
Chicago,  IL  40411 

1  Nr,  Robxt  NcKinley 
Aaarican  College  Testing  Prograos 
P.O.  So>  146 
Iona  City,  lA  32243 

1  Or.  Oarhara  Naans 
Hooao  Rasourcas  Rasaarch  Organiaation 
300  North  Nashington 
Alexandria,  VA  22314 


Profnior  Jason  Nillsan 
Oapartaant  of  Education 
Stone  Hall 
Cxnall  Univxsity 
Ithaca,  NY  14833 


Page 

Private  Uctor 

1  Dr.  N.  Alan  Nicanandx 
Univxsity  of  Oklahooa 
Oepartrent  of  Psychology 
Dklahona  City,  OK  73049 

1  Sr.  Ooaaid  A  Ncroan 
CognitivfrSeianca,  C-0J5 
Uoiv.  of  California,  San  Oiago 
La  Jolla,  CA  92093 

1  Or.  Nalvto  8.  Novick 
334  Undquist  Center  for  Haasuraent 
Univxsity  of  Iona 
Iona  City,  lA  52242 

1  Or.  Jaaao  01 son 
NICAT,  Inc. 

1873  Scath  State  Street 
Om,  UT  84(07 

1  Nayna  R.  Patience 
Aaarican  Council  on  Education 
SED  THting  Service,  Suite  20 
One  Dupont  Cirla,  NN 
Nashington,  DC  20034 

1  Or,  Jaaes  Paulsoa 
Oapt.  of  Psychology 
Portland  State  UniveSrsity 
P.O.  Box  731 
Portland,  (»  97207 

1  Or.  Janas  N.  Pellagrino 
Univxsity  of  California, 

Santa  Barbara 
Dept,  of  Psychology 
Santa  Bxabara  ,  CA  93104 

I  Dr.  Douglas  H.  Jonas 
Advanced  Statistical  Technologies 
Corpxatioo 
10  Trafalgar  Court 
Lanrencavilla,  NJ  08148 

I  Or.  Stevan  E.  Poltrock 
Ball  Labxatxin  21M44 
400  Nountain  Ava. 

Ihirray  Hill,  NJ  07974 


1  Or,  Nark  0.  Reckase 
ACT 

P.  0.  Box  148 
Iona  City,  lA  32243 


4-Jun-84 


1  Dr.  Robert  Nislavy 
711  Illinois  Stmt 
Senava,  IL  40134 


m  sfour  j  -Col  uaki  a/TiutakjN 
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Ptgt  9 


Pri¥tt§  SKtsr 

1  3r.  ThoMS  RtynoUs 
IMivKiity  of  TcxacOallas 
narkttlnq  Stpartatnt 
P.  0.  Box  488 
Ricftantfon,  TB  7S080 

!  Dr.  Laitrinct  Rudntr 
M3  Eli  Avtnui 
Takoia  Park,  H8  20012 

I  Dr.  1.  Ryan 
Ofpartatnt  of  Education 
University  of  South  Carolina 
Coluabia,  SC  29208 

1  PROF.  FUHIKO  SAHEJIHA 
DEPT.  OF  PSYCHOLOBY 
UMIVERSITY  OF  TENNESSEE 
KNOIVILLE,  TN  37914 

1  Frank  L.  Schiidt 
Oepartient  of  Psychology 
Bldg.  SB 

George  Hashington  University 
Nashington,  DC  20032 

1  Or.  Halter  Schneider 
Psychol  qy  Oepartient 
403  E.  Daniel 
Chaapaign,  IL  41820 

1  Lonell  Schoer 
Psychological  4  Duantitative 
Foundations 
Collqe  of  Education 
Univesity  of  Iona 
loua  City,  I A  32242 

1  Or.  Euanuel  Oonchin 
Oepartient  of  Psychology 
University  of  Illinois 
Chaepaign,  IL  41820 

1  Or.  Kaauo  Shigeeaeu 
7*9*24  Kugmuaa-ICaigao 
FujusaM  231 
JAPAN 

1  Or.  Hilliaa  Siis 
Center  for  Naval  Analysis 
200  North  Seaurqard  Street 
Alexandria,  9A  22311 


Private  SKtx 

1  Sr.  H.  Nallacc  Sinaiko 
Prograi  DirectX 

Nanpoux  Resevch  and  Advisxy  Sxvices 
Seithsonian  Institution 
801  Nxth  Pitt  Street 
Alexandria,  VA  22314 

1  Nxtha  Stocking 
Educational  Testing  Sxvice 
Princetott,  NJ  08341 

1  Dr.  Petx  Stolo44 
Centx  far  Naval  Analysis 
200  Mrth  Beaxqxd  Street 
Alexandria,  VA  22311 

1  Or.  Nilliu  Stout 
Univxsity  of  Illinois 
Depxtient  o4  Hatheiatics 
Urbana,  IL  41801 

1  OR.  PATRICK  SUPPES 
INSTITUTE  FOR  NATHEHATICAL  STUDIES  IN 
THE  SXIAL  SCIENCES 
STANFORD  UNIVERSITY 
STAtU^OFO,  CA  94303 

1  Dr.  Hxihxao  Suaiinathan 
Laboratory  of  Psychoietric  and 
Evaluation  RoMxch 
School  of  Education 
Univxsity  of  Nassachusetts 
Aahxst,  NA  01003 

1  Or.  Xikuii  Tatsuoka 
Coaputer  Based  Education  Rnearch  Lab 
232  Engineering  Resexch  Labxatory 
Urbana,  IL  41801 

1  IN'.  Naurici  Tatsuoka 
220  Education  Bldg 
1310  S.  Sixth  St. 

Chaapaign,  IL  41820 

1  Dr.  David  Thissin 
Depxtaeot  of  Psychol  qy 
Univxsity  of  Kansas 
Laxcnct,  XS  44044 

1  Or.  Douglas  Toune 
Univ.  of  So.  Callfxnia 
Bah'avixal  Txhnolqy  Labs 
1843  S.  Elena  Ave. 

RMondc  Bnch,  CA  90277 


NisfOttri-Coluakia/TsutakaM 
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Privatt  SKtx 

1  Or.  Robirt  Tsutakaita 
Oapartimt  of  Statistics 
Univsrsity  of  Rissouri 
Coliubia,  NO  &S201 

1  Sr.  Lfdyard  Tuekir 
Univsrsity  of  Illinois 
SsRartomt  of  Psychology 
M3  E.  Daniel  StrHt 
Chaspaign,  IL  il820 

1  Dr.  V.  R.  R.  Uppuluri 
Union  Carbidt  Corporation 
Nucltar  Division 
P.  0.  Dox  T 
Oak  Ridgt,  TN  37830 

1  Dr.  David  Vais 
Assessosnt  Systsos  Corporation 
2233  University  Avtous 
Suits  310 
St.  Paul,  RN  33114 

1  Dr.  Honard  bainsr 
Division  of  Psychological  Studios 
Educational  Testing  Service 
Princeton,  M  08340 

1  Or.  Hlchael  T.  bailer 
Departaent  of  Educational  Psychology 
University  of  bixonsin-HlileaHkn 
Hiluaukes,  bl  33201 

1  Or.  Drian  Raters 
HeeRM 

300  North  bashington 
Alexandria,  VA  22314 

1  Dr.  David  1.  bsise 
RAM  Elliott  Hall 
University  of  Rinnesota 
73  E.  River  Road 
NinnMpolis,  NN  33433 

1  Dr.  Rand  R.  bilcox 
Univsrsity  of  Soothern  California 
Departaent  of  Psychology 
Los  AngelH,  CA  90007 


Private  SKtor 

1  6ersan  Nilitary  Representative 
ATTN:  bolfgang  bildegrube 
Strcitkraaftcaat 
D-S300  Bonn  2 
4000  Brandyuine  Strut,  Nb 
bashington  ,  DC  2001A 

1  Dr.  Dnics  bUlians 
OepartoMt  of  Edocatinal  Psychology 
University  of  Illinois 
Urbana,  IL  61801 

1  Rs.  Rarilyn  bingersky 
Educational  Testing  Sxvice 
Princeton,  M  08341 

1  Or.  bendy  Ym 
CTB/Ncfirae  Hill 
Del  Roots  Rueareft  Park 
Nontorey,  CA  93940 


